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DETAILED ACTION 
Response to Arguments 

On page 12, applicant argues tliat tlie amendnnents to claims 10-18 and 34 
overcome the 101 rejections. While the applicant's points are understood, the examiner 
respectfully disagrees. The examiner notes that since the mobile terminal is not limited 
in the claim to an electronic device, the mobile terminal can broadly be interpreted as a 
person walking around (mobile) processing the data, thus directing the claimed 
invention towards non-statutory subject matter. Therefore the rejection has been 
maintained. 

On pages 13-15, applicant argues that Murphy fails to disclose direction data that 
is formatted in two bytes, wherein the first byte provides compass heading information 
and the second byte provides compass bearing information of the photographed object. 
While the applicant's points are understood, the examiner respectfully disagrees. See 
for example Murphy figure 2. There Murphy discloses in circle 430, compass 
orientation and heading information. The examiner notes that it is well known that data 
is processed in units of bytes. Hence, one byte will contain the compass heading 
information while another byte will contain the compass bearing information. Murphy 
further discloses in column 9, lines 50-60, determining the location of the photographed 
object. Furthermore, the examiner notes that the claim does not require only two bytes 
or define which byte contains which information. Hence, as broadly interpreted by the 
examiner, the sections of Murphy listed above disclose the claimed limitations. 
Therefore the rejection has been maintained. 
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Claim Rejections - 35 USC § 101 

35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, macliine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

Claims 10-18 and 34 are rejected under 35 U.S.C. 101 as not falling within one of 
the four statutory categories of invention. While the claims recite a series of steps or 
acts to be performed, a statutory "process" under 35 U.S.C. 101 must (1) be tied to 
another statutory category (such as a particular apparatus), or (2) transform underlying 
subject matter (such as an article or material) to a different state or thing (Reference the 
May 15, 2008 memorandum issued by Deputy Commissioner for Patent Examining 
Policy, John J. Love, titled "Clarification of 'Processes' under 35 U.S.C. 101"). The 
instant claims neither transform underlying subject matter nor positively tie to another 
statutory category that accomplishes the claimed method steps, and therefore do not 
qualify as a statutory process. It is unclear what performs the various processing steps 
recited in the method claim. 

Claim Rejections - 35 USC § 103 

1 . The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or deschbed as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the phor art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

2. Claims 1 , 3-4, 6-8, and 26-28 and 33 are rejected under 35 U.S.C. 1 03(a) as 
being unpatentable over Irube et al. (2001/0041586), (hereinafter referred to as "Irube") 
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in view of Murpliy et al. (6282362), (liereinafter referred to as "Murpliy") in furtlier view 

of Berstis (6542824). 

Regarding claim 1, Irube discloses a communication terminal apparatus 
combined with a handset with high probability (Irube: paragraph 0001, lines 1-3). 
This apparatus comprises a "codec for performing converting operation between 
analogue voice data and digital voice data" (Irube: figure 1 , item 23, wherein the 
voice codec is the codec), "camera module connected to a camera installed 
within the mobile terminal for performing converting operation between analogue 
image data and digital image data" (Irube: figure 1 , items 4 and 25), 
"voice/image communication apparatus for multiplexing or demultiplexing the 
converted voice, image, direction data, and frame" (Irube: figure 1, items 17 and 
20, wherein the multiplexer/demultiplexer are part of the communication 
apparatus, paragraph 0113, lines 1-4, wherein the frame is a combination of the 
voice, video, and direction or other data), "LCD module for displaying image and 
direction data" (Irube: figure 1, items 14, 16, and 28, wherein the camera 
direction sensor unit provides the direction data and the video encoder provides 
the image data), "a speaker" (Irube: figure 2) and a "control unit for controlling 
each unit generally" (Irube: figure 1 , item 1 1 ). Although Irube fails to show a 
direction sensor for detecting the compass orientation direction of a 
photographing object and displaying the direction data within the LCD, Irube 
does show a camera direction sensor unit (Irube: figure 1 , item 28) for detecting 
the presence of the camera (Irube: paragraph 0047, lines 18-19). Murphy 
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teaches that prior art camera systems fail to provide rapid selection and display 
of geographically associated features of an object image (Murphy: column 6, 
lines 5-10). To help alleviate this problem, Murphy discloses "detecting a 
compass orientation direction associated with an image, wherein the data is 
formatted in two bytes, wherein the first byte provides compass heading 
information and the second byte provides compass bearing information" (Murphy: 
figure 2; column 13, lines 60-67. The examiner notes that it is well known that 
digital information is processed in units of bytes, with each byte comprising a 
different piece of information). Rossi teaches that angles, compass headings (or 
compass orientation), and GPS coordinates, along with a camera, can be used to 
determine the objects location or direction (Rossi: column 4, lines 1-36). Berstis 
teaches that GPS receivers are a cost prohibitive way of determining the position 
and time information of an object (Berstis: column 1, lines 47-53). To overcome 
this problem, Berstis discloses an apparatus that determines and subsequently 
displays the compass orientation direction without using a GPS receiver (Berstis: 
column 1 , lines 57-60, column 6, lines 57-61 ). Berstis further discloses "checking 
whether a direction displaying mode has been selected and controls the display 
module to display the demultiplexed image and direction data" (Berstis: figures 
3A-3B; column 6, lines 15-37). Therefore, it would have been obvious to one 
having ordinary skill in the art at the time the invention was made to implement 
the camera direction sensor unit disclosed by Irube with the angle, compass, and 
GPS coordinates taught by Murphy, and add the direction displaying taught by 
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Berstis, in order to obtain an apparatus tliat more precisely and cost effectively 
locates and displays the direction of an object. Further, one would be motivated 
to do so since Irube is silent as to how the object location is determined. 

Regarding claim 3, see the examiners comments for claim 1 and note that 
in the combination of Irube and Murphy as applied to claim 1 , Irube discloses a 
"voice encoding processing unit for encoding the voice data input from the codec 
or converting the voice data into data for transmitting to a speaker" (Irube: figure 
1 , items 23 and 27, wherein the video encoder receives and encodes the voice 
data from the voice codec, item 2, wherein the voice data is transmitted to the 
handset, which contains a speaker), "image encoding processing unit for 
encoding the image data" (Irube: figure 1 , item 27, wherein the image encoder is 
the video encoder), and "multiplexing unit for multiplexing the voice, image, and 
direction data" (Irube: figure 1, items 17 and 20). Murphy discloses "obtaining 
the direction data" (Rossi: figure 2). 

Regarding claim 4, Murphy discloses "calculating the compass orientation 
direction and encodes calculated compass orientation direction by formatting the 
orientation direction into a binary value" (Murphy: column 13, lines 60-67; figure 
2). 

Regarding claim 6, Murphy discloses "displaying a direction on the screen" 
(Rossi: figure 2, wherein the display displays the direction). 
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Regarding claim 7, altliougli not sliown, it would have been obvious to 
display the direction on the screen in the form of a compass (Official Notice). 
Doing so would have been obvious to make the direction easier to view and read. 

Regarding claim 8, see the examiners comments for claim 1 and note that 
in the combination of Irube and Murphy as applied to claim 1 , Irube discloses that 
the "multiplexing unit multiplexes the encoded packet data and compass 
orientation direction data by receiving data from the voice, image, and direction 
units and inputs the data to the image frame by forming a flag and header" 
(Irube: figure 1, items 27, 28, 23, 17, and 20, wherein the multiplexer multiplexes 
data from the video encoder, voice codec, and camera direction unit, figure 12 
and paragraph 0039, line 7, wherein the voice/video conversation appears to be 
in the flag/header format which would comply with the MPEG 4 standards 
disclosed by Irube. Had Irube and Murphy been combined as disclosed above. 
Murphy would supply the compass orientation data to be multiplexed, wherein 
the compass orientation data is the compass heading). 

Regarding claims 26-28 and 33, note the examiners rejection for claims 1 , 
3, and 4. 

3. Claims 9 and 1 1 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Irube et al. (2001/0041586), (hereinafter referred to as "Irube") in view of Murphy et al. 
(6282362), (hereinafter referred to as "Murphy") in further view of Berstis (6542824) in 
further view of Takahashi et al. (6516094), (hereinafter referred to as "Takahashi"). 
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Regarding claims 9 and 11, note tlie examiners rejection for claims 1 and 
1 9, and in addition, claims 9 and 1 1 differ from claims 1 and 1 9 in that claims 9 
and 1 1 , further require the formation of null data. Takahashi teaches that when a 
reference region is not described, i.e. no information/data is contained on the 
reference region to transmit, null data is formed and inserted into the description 
region (Takahashi: figure 5d, column 6, lines 55-61). Therefore, it would have 
been obvious to one having ordinary skill in the art at the time the invention was 
made to implement the camera direction sensor unit disclosed by Irube with the 
angle, compass, and GPS coordinates taught by Murphy, add the direction 
displaying taught by Berstis, and add the formation of null data taught by 
Takahashi in order to obtain an apparatus that more precisely locates the 
direction of an object. Further, one would be motivated to do so since Irube is 
silent as to how the object location is determined. 
4. Claims 5, 10, and 12-18 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Irube et al. (2001/0041586), (hereinafter referred to as "Irube") in 
view of Murphy et al. (6282362), (hereinafter referred to as "Murphy") in further view of 
Berstis (6542824) in further view of Rudow et al. (6236940), (hereinafter referred to as 
"Rudow"). 

Regarding claim 5, note the examiners rejection for claims 1 and 19, and 
in addition, claim 5 differs from claims 1 and 19 in that claim 5 further requires 
having a displaying area on one side of the screen. Rudow teaches that having 
the direction, or position, of a golfer on one side of the screen enables more 
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information to be displayed elsewliere (Rudow: figure 12, column 61, lines 55- 
65, wherein having the golfers direction displayed in the corner of the screen 
enables the hole information to be displayed as well, as opposed to having the 
golfers position take up the entire screen). Therefore, it would have been 
obvious to one having ordinary skill in the art at the time the invention was made 
to implement the camera direction sensor unit disclosed by Irube with the angle, 
compass, and GPS coordinates taught by Rossi, add the direction displaying 
taught by Berstis, and add the display means taught by Rudow in order to obtain 
an apparatus that more precisely locates and displays the direction of an object. 
Further, one would be motivated to do so since Irube is silent as to how the 
object location is determined. 

Regarding claims 10 and 12, note the examiners rejection for claims 1 and 
5, and in addition, Irube in view of Murphy in further view of Berstis in further view 
of Rudow disclose "detecting the data demultiplexed image and direction data 
and transmitting to the displaying unit" (Irube: figure 1 , paragraph 01 13), 
"checking for a direction displaying mode" (Rudow: figure 6, wherein the list of 
menu choices on the right, i.e. 1-9, sets the hole to be displayed), "determining 
the position and method in displaying the direction and image data on the LCD if 
direction mode is set" (Rudow: figures 6 and 20, wherein the position is 
determined with the aid of GPS data, column 4, lines 1-3), "displaying the 
direction and image on the LCD" (Rudow: figures 6 and 20) and "displaying the 
compass orientation data within the image on the screen of the LCD, the 
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compass orientation direction data being associated witli a direction of tlie 
image, tlie image being located in a pliotograpliing direction of tlie camera" 
(Berstis: column 6, lines 50-67, wherein the compass orientation data is the 
arrow and compass points). 

Regarding claim 13, Rudow discloses "the LCD displays only image data 
read from the voice/image communication apparatus if the direction displaying 
mode is not set" (Rudow: figure 13, wherein the image communication 
apparatus is the box 18 which includes a video controller, column 10, lines 34-38, 
wherein pop up windows or other various messages are displayed on the screen, 
column 4, lines 1-3). 

Regarding claim 14, Rudow discloses having "a direction displaying area 
at one side of the screen" (Rudow: figure 20, wherein the direction displaying 
area is the left/center of the screen which shows the direction of the hole). 

Regarding claim 15, Murphy discloses "displaying a direction on the 
screen" (Murphy: figure 2). 

Regarding claims 16, although not shown, it would have been obvious to 
display the direction on the screen in the form of a compass (Official Notice). 
Doing so would have been obvious to make the direction easier to view and read. 

Regarding claim 17, Irube discloses "displaying comprises a transmitted 
stop image" (Irube: figure 12, wherein the End Negotiation frame is the stop 
image). 
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Regarding claim 18, Rudow and Berstis disclose "the LCD further displays 
time and date information with the image and compass orientation data" (Rudow: 
figure 20, column 5, lines 62-64, wherein it is determined, from the GPS 
satellites, the dates of the games played, column 4, lines 1-3; Berstis: column 6, 
lines 57-61). 

5. Claim 32 is rejected under 35 U.S.C. 103(a) as being unpatentable over Irube et 
al. (2001/0041586), (hereinafter referred to as "Irube") in view of Murphy et al. 
(6282362), (hereinafter referred to as "Murphy") in further view of Berstis (6542824) in 
further view of Vance et al. (6992699). 

Regarding claim 32, note the examiners rejection for claim 1 , and in 
addition, claim 32 differs from claim 1 in that claim 32 further requires displaying 
on the screen of a camera phone. Vance teaches displaying information on 
camera phones (Vance: figures 1-3; column 3, lines 6-25). Therefore, it would 
have been obvious to one having ordinary skill in the art at the time the invention 
was made to implement the display on the camera phone taught by Vance in 
order to obtain a more versatile apparatus by being able to view the display in a 
plurality of different places via the use of a camera phone. 

Regarding claim 36, note the examiners rejection for claim 1 . 

6. Claims 29-31 and 35 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Irube et al. (2001/0041586), (hereinafter referred to as "Irube") in view of Murphy et 
al. (6282362), (hereinafter referred to as "Murphy") in further view of Berstis (6542824) 
in further view of Yamagishi et al. (6084630), (hereinafter referred to as "Yamagishi"). 
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Regarding claim 29, note tlie examiners rejection for claim 1 , and in 
addition, claim 29 differs from claim 1 in that claim 29 further requires the use of 
packets. Yamagishi teaches that user's might experience disorder at the 
reproduction of video due to a different between compression ratios (Yamagishi: 
column 1, lines 48-51). To help alleviate this problem, Yamagishi discloses 
"direction, voice, and image data in a packetized format, wherein a first portion of 
the direction data is provided between the voice data and image data, and a 
second portion of the direction data is provided between the first and second 
portions of the image data" (Yamagishi: figure IB; column 7, lines 23-40, 
wherein the direction data would be contained in the data packet. The examiner 
notes that the placement of the packets within the stream is a non-critical 
element of the claim, and hence, all the packets disclosed by Yamagishi will be 
transmitted to a receiver). Therefore, it would have been obvious to one having 
ordinary skill in the art at the time the invention was made to implement the 
packets taught by Yamagishi in order to better help prevent the user from a 
disorder feeling. 

Regarding claims 30-31, note the examiners rejection for claims 1, 3, and 

4. 

Regarding claim 35, note the examiners rejection for claim 1 . 
7. Claim 34 is rejected under 35 U.S.C. 103(a) as being unpatentable over Irube et 
al. (2001/0041586), (hereinafter referred to as "Irube") in view of Murphy et al. 
(6282362), (hereinafter referred to as "Murphy") in further view of Berstis (6542824) in 
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further view of Rudow et al. (6236940), (liereinafter referred to as "Rudow") in furtlier 
view of Yamagislii et al. (6084630), ([Hereinafter referred to as "Yamagislii"). 

Regarding claim 34, note the examiners rejection for claim 1 , and in 
addition, claim 34 differs from claim 1 in that claim 34 further requires the use of 
packets. Yamagishi teaches that user's might experience disorder at the 
reproduction of video due to a different between compression ratios (Yamagishi: 
column 1, lines 48-51). To help alleviate this problem, Yamagishi discloses 
"direction, voice, and image data in a packetized format, wherein a first portion of 
the direction data is provided between the voice data and image data, and a 
second portion of the direction data is provided between the first and second 
portions of the image data" (Yamagishi: figure IB; column 7, lines 23-40, 
wherein the direction data would be contained in the data packet. The examiner 
notes that the placement of the packets within the stream is a non-critical 
element of the claim, and hence, all the packets disclosed by Yamagishi will be 
transmitted to a receiver). Therefore, it would have been obvious to one having 
ordinary skill in the art at the time the invention was made to implement the 
packets taught by Yamagishi in order to better help prevent the user from a 
disorder feeling. 

Conclusion 

THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 
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A shortened statutory period for reply to tin is final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to DAVID CZEKAJ whose telephone number is (571)272- 
7327. The examiner can normally be reached on Mon-Thurs and every other Friday. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mehrdad Dastouri can be reached on (571) 272-7418. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 
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Information regarding tlie status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/Dave Czekaj/ 

Primary Examiner, Art Unit 2621 



